COMPLEMENTS OF RATIONALLY CONVEX SETS 



E. S. ZERON 

Abstract. The main objective of this paper is to show that the com- 
plement of a rational convex set in C n is (n — 2)-connected. 



1. Introduction 

A compact subset K of C n is said to be rationally (respectively polyno- 
mially) convex if for every point yo i n the complement C n \ K there exists a 
non-constant holomorphic polynomial P such that P(yo) = 1 axid 1 ^ P{K) 
(respectively ||-P||jc < 1)- Notice that each polynomially convex set is ratio- 
nally convex. 

Rationally and polynomially convex sets play an extremely important 
role in complex analysis and approximation theory; we refer the reader to 
Stolzenberg and Alexander and Wermer |2j. Nevertheless, it is usually a 
difficult problem to decide whether a given compact set is rationally or poly- 
nomially convex. Therefore, the results that provide topological obstructions 
to rational or polynomial convexity are of special interest to complex analy- 
sis. Recently, Forstneric [H] proved via Morse theory that the complement of 
a polynomially convex set is simply connected. The main objective of this 
paper is to show that the complement of a rationally convex set is simply 
connected as well. 

Theorem 1 (Main). Let K be a compact rationally convex set in C n , the 

complement C n \K is simply connected for n > 3. 

We prove Theorem ^ i n the second section of this paper. Notice that 
the complement of any compact rationally convex set K in C n is arcwise 
connected whenever n > 2. Actually, the complement of K has only one 
unbounded arcwise connected component because K is compact; and C n \K 
has no bounded arcwise connected components because it is exhausted by 
unbounded algebraic hypersurfaces Q~ l (l) C C n , with Q a non-constant 
holomorphic polynomial of several variables. Thus, we need not specify any 
base point for calculating the fundamental group of C ra \ K in Theorem^ 
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Moreover, the proof of Theorem^s based in the fact that the complement 
C n \ K may also be exhausted by smooth algebraic hypersurfaces TL C C n of 
complex dimension n— 1, and so the relative pair (TL,TL\Br) is arcwise and 
simply connected for n > 3 and Br an open ball in C n with centre in the 
origin and radius R > large enough; see Lefschetz theorem in p. 552]. 
Suppose from now on that TL is an algebraic hypersurface in C n , with n > 4, 
and recall Theorem 5.2 of ^3 p. 45]. We have that the intersection TL H S$ 
is (n — 3)-connected for every sphere S$ C C n with centre in yo £ TL and 
radius 5 > small enough. Thus, we may consider the question whether 
the intersection TL H S is also simply connected for any arbitrary sphere 
S C C n . A positive answer to previous question would shine light on a 
proof to the following possible extension of Theorem ^ The complement 
S \ K is simply connected for each rationally convex set K contained in a 
sphere S C C n with n > 4. Unfortunately, the intersection of a smooth 
algebraic hypersurface TL C C n and a sphere 5 C C n is not necessarily 
simply connected, as the following example shows, 

Example 2. Consider the polynomial Q2{z) = z\ + z| defined on C n with 
n > 3. It is easy to calculate that the hypersurface 1 (1) is smooth, and 
the intersection of Q^ 1 (l) with the unitary sphere {X] l z fc| 2 = 1} is equal 
to the one-dimensional circumference defined by the equations: z& = for 
k > 3, 

K(zi) 2 + K(z 2 ) 2 = 1 and = 9(z 2 ) = 0. 

In any case, it will be quite interesting to deduce whether the complement 
S \ K is simply connected for each rationally convex set K contained in a 
sphere S C C n with n > 4. On the other hand, Theorem ^ does not hold 
for the 2-dimensional space C 2 as the following simply example shows. 

Example 3. Consider the standard torus T 2 in C 2 defined by \x\ = \y\ = 1. 
It is easy to see that T 2 is rationally convex. Let To be a path parametrised 
by t i— > (2, t) sin(t) in the real plane M. 2 , for < t < n. The path To begins 
at the origin, runs one time around the point (1, 1) and comes back to the 
origin again. The compact set E composed of those points (x, y) € C 2 with 
absolute values \y\) in To is then homeomorphic to To x T 2 with the 
fibre {0} x T 2 identified as a single point. Moreover, the intersection of T 
and E is empty, the set E is a strong deformation retract of the complement 
C 2 \ T 2 , and so, the first homotopy group of C 2 \ T 2 is equal to the integer 
numbers. 

We strongly recommend the works of Bredon 3 j and Spanier ^1 for ref- 
erences on homotopy theory. Besides, recalling the works of Givental' 
Duval 6 and Duval and Sibony we may construct non-orientable com- 
pact smooth submanifolds M of C 2 which are rationally convex and the 
first homotopy groups of their complements C 2 \ M are not trivial. Finally, 
a direct application of algebraic topology yields the following extension of 
Theorem Q We present more applications in the third section of this paper. 
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Corollary 4. Let K be a compact rationally convex set in C n , its comple- 
ment is (n — 2)-connected for n > 3: 

(1) ir k (C n \K)=0 when 1 < k < n - 2; 
and for any commutative group G, 

(2) H k (C n \ K, G) = when 1 < k < n - 2. 

Proof. We know that C n \ is arcwise and simply connected, because The- 
orem n Hence, applying Hurewicz theorem p. 398], we have that equa- 
tion (^Q) can be directly deduced from equation ©. 

On the other hand, because of their definition, every rationally convex 
set K has a system of Stein open neighbourhoods (open rational polyhedra) 
{Up} in C n , and so K = f]^ Up. It is well known that each Stein open set 
Up C C ra has the homotopy type of a CW-complex of real dimension less 
than or equal to n, see p. 26] or ^2 p. 548]. Whence, all cohomology 
groups H k (Up,G) vanish for any commutative group G and k > n + 1. 
Alexander (and Cech) cohomology groups H k (K, G) vanish as well for k > 
n + 1, because they are equal to the direct limits of H k (Up, G) when Up runs 
over a system of open neighbourhoods of K, see for example |15l p. 291] or 
p- 348] . Finally, a direct application of Alexander duality theorem yields 
equation ((2J), as we wanted, see [E, P- 296] or ;3, p. 352]. Notice that 
singular H k (-) and reduced -£/&(') homology groups coincide for k > 1. □ 

Recall that a compact rational polyhedron IT in C n is a set defined by the 
finite intersection, 

(3) n := Bnf] k Q k HD k ), 

where B C C n is any compact ball, {Q k } is a finite collection of holomor- 
phic polynomials on C n , and each D k C C is either the compact unit disk 
< 1} or the closed ring {\w\ > 1}. Obviously, every compact rational 
polyhedron is rationally convex; and by an open rational polyhedron we 
understand the topological interior of a compact one. 

We prove Theorem ^ i n the next section, and several applications are 
presented in the third section of this paper. 

2. Proof of main Theorem [T] 

The proof is based in the following two classical results on holomorphic 
polynomials. Firstly, we need Lefschetz result on hyperplane sections, where 
it is stated that the one-point compactification of a smooth algebraic hy- 
persurface is arcwise and simply connected. A simplified proof and several 
generalisations can be found in Hamm or Karcjauskas |12j . 

Theorem 5 (Lefschetz). Let X be a non-singular (smooth) algebraic hy- 
per surf ace in C n , for n > 3. There then exists a finite real number Rq > 
such that the relative pair (X,X \ Br) is (n — 2)-connected for every open 
ball Br C C™ of radius R> Rq and centre in the origin. 
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This version of Lefschetz theorem can be easily deduced from the remark 
in ^Tj p. 552], we just need to observe that XHBr is Stein and to fix H equal 
to the complement of Br. Besides, the natural existence of Rq > in The- 
orem El is easily understood after comparing Theorem 6.9 in p. 26] with 
Theorem 2 or 3 in On the other hand, we also need the following result 
where it is shown that any non-constant holomorphic polynomial defined 
on <C n almost induces a locally trivial fibre bundle on C n , see Verdier |17j . 
Broughton |3j and Ha Huy Vui [El • 

Theorem 6. Let Q : C" — > C be a non-constant holomorphic polynomial. 
Then, there exists a finite set Aq in C such that the fibres of Q induce a 
locally trivial fibre bundle of C n \ Q^ 1 (Aq) with base on C \ Aq. 

We need to combine previous two theorems into the following version of 
Lefschetz theorem for fat open sets. 

Lemma 7. Let Q : C n — > C be a holomorphic polynomial, for n > 3, and 
0, be a bounded open set in C whose compact closure fi is diffeomorphic to 
the unit disk {\w\ < 1} and does not intersect the finite set Aq defined in 
Theorem^ Given any ball Br in C n of finite radius R > and centre in 
the origin, there exists an unbounded (n — 2) -connected set T,r in C n such 
that Br n T,r is equal to the open set Q -1 ^) n Br. 

Proof. The result is trivial when Q is a constant polynomial, so we suppose 
from now on that Q is a non-constant function. The compact set f2 is con- 
tracture in C \ Aq, for it is diffeomorphic to the unit disk, so the fibres of 
Q induce a global trivial fibration of with base on Q; recall Theo- 

rem |f)] and consider ^ p. 140] or p. 27]. That is, given wo in Q, there 
exists a smooth function g defined from Q^ 1 ^!) onto the non-singular fibre 
X := Q~ 1 (wq), such that the pair [Q,g] is a fibration diffeomorphism (it 
preserves fibres) from Q _1 (Q) onto Q x X. 

In particular, the restriction g\x is an auto-diffeomorphism; and we may 
even fix g such that g\x is the identity function. Besides, the norm ||g(z)|| 
converges to infinity if and only if \\z\\ goes to infinity for z in recall 
that Q is compact. Given any finite radius R > 0, choose a real number 
/)> R such that the compact set g(Q^ 1 (Q) HBr) is contained inside Xf]B p , 
and so define the bounded open set, 



Where [Q,(?] -1 is the inverse diffeomorphism defined from Q x X onto 
Q^ 1 ^). Since X = Q ^^o) and the intersection n Br is con- 

tained inside Er, because of the way we chose p 2> R, we can deduce that 
the following pair of equalities holds, 



(4) 



e p ■■= x (xnB p )) c Q-\n). 



(5) 



E p nB R 

XUE p 



Q-\n)nB R , 

[Q,g}- 1 ([{w }xX]u[nx(xnB p )]). 
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The open set f2 is contractible, for it is diffeomorphic to C. Therefore, the 
spaces X U E p and X have the same homotopy type. Actually, it is easy to 
deduce that X is a strong deformation retract of X U E p . 

On the other hand, Theorem El implies that the pair (X,X\B a ) is (n — 2)- 
connected for any radius a 3> p large enough. We may choose a S> p such 
that X = Q~ 1 (wo) meets transversally the sphere dB a , see Theorem 6.9 in 
[31 p. 26]. Hence, if B% is the complement of B a in C n , we automatically 
have that the pair (B^ U X, B^) is (n — 2)-connected. Finally, we may even 
fix a ^> p larger enough such that the open ball B a contains the compact 
set E p defined according to ®. Thus, the spaces X U E p and X have the 
same homotopy type and are equal outside the ball B a . The pair (E^-B^) 
is then (n — 2)-connected for £# defined as the union B^ U X U E p . A direct 
application of the long exact sequence, see p. 87] or ^3 p. 374] 

-» 7Tfc(flJ) - 7Tfc(Efl) - 7r fc (E fl) 55) - 

automatically yields that £# is (n— 2)-connected as well, recall that the com- 
plement 1?£ is (2ra — 2)-connected. It is easy to deduce that E# is unbounded 
and arcwise connected, because all the arcwise connected components of X 
and X U E p are unbounded, and so they all meet the complement B%. Fi- 
nally, since a S> p 3> R and using equation (J5J, we may conclude that 
Br D £_r is equal to the open set Q~ 1 (Q) n -Br, as we wanted. □ 

The proof of Theorem ^ follows now an inductive process. Recall the 
definition of a compact rationally polyhedron given in equation Q. The 
complement of any compact ball B in C n is obviously simply connected. 
Thus, given any rationally convex set K in C n whose complement is simply 
connected, we only need to prove that the union of and C n \ K is 

also simply connected for all open sets Q, in C and holomorphic polynomials 
Q in C n . We prove previous statement in several steps. 

Lemma 8. Let Q : C n — > C be a holomorphic polynomial, for n > 3, and 
II be any compact rational polyhedron in C n whose complement is simply 
connected. The union of Q -1 (f2) and C n \ II is then simply connected for 
every bounded open set f2 in C whose compact closure £1 is diffeomorphic to 
the unit disk {\w\ < 1} and does not intersect the finite set Aq defined in 
Theorem 

Proof. The result is trivial whenever Q is a constant polynomial, so we 

n 

suppose from now on that Q is a non-constant function. Define II to be 
the complement C n \ LT, so the open set 11^ is simply connected because of 
the given hypotheses, and arcwise connected because II is rationally convex. 
Given an arbitrary closed path (loop) T inside Q~ l (Q) union IT"*, choose a 
ball Br with centre in the origin and radius R > large enough such that 
the compact sets IT and T are both contained inside Br. 

Lemma implies the existence of an unbounded (n — 2)-connected space 
Er in C n such that Br n Er is equal to the open set Q~ 1 (Q) n Br. Notice 
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in particular that T*r is both arcwise and simply connected because n > 3. 
Since II is contained in Br, the union of and 1$ is equal to both 

spaces: T,r U ifi and the complement of II \ in C™. We show that 

the loop T is homotopically trivial in S/j U 11^ via an alternative version of 
Van-Kampen's theorem ^ p. 63]. 

The spaces T,r and ifi are both simply connected because of Lemma 

n 

and the given hypotheses, so we suppose that T meets T,r and LT . Since the 
loop T is contained in Br, we can decompose it as the finite sum Y^k ^ °f 
non- necessarily closed paths contained inside either the open set BrCi'Er 

n 

or the open complement LT , and moreover, such that the end points of the 
paths Yfc are all in the intersection T,r n 1$. Actually, since LT is compact 
and T,r is unbounded, the space T,r PI is not empty, and so we can fix a 
point wq there. 

Suppose that D 1$ is also arcwise connected. We can then construct 
closed paths (loops) by joining both end points of each to the fix point 
Wq with arcs of the appropriated orientation in Y,r n IT . Every loop is 
contained inside one of the simply connected spaces or II''. Hence, the 
original loop T is homotopic to the finite sum £\ Tf. in the union U IT^, 
and moreover, the loops are all homotopically trivial there. In other 
words, the union of an d ifi is simply connected, because it is equal 

n 

to T*r U LT and the original loop T is homotopically trivial there. We just 
need to show now that the intersection of and ifi is indeed arcwise 
connected, in order to complete the proof of Lemma |H1 

Recall the proof of Corollary |IJ Every rationally convex set K in C n has 
a system of Stein open neighbourhoods, and so the Alexander cohomology 
group H 2n ~ 2 (K) vanishes for n > 3, see f5J p. 26] and [E3 P- 291]. The 
reduced homology group Hi(C n \ K) vanishes as well because Alexander 
duality theorem |15l p. 296]. Since Y,r U IT^ is the complement in C n of the 
rationally convex set II \ Q~ l {yi), as it is indicated the second paragraph 
of this proof, we have that Hi(T,r U LT^) vanishes. On the other hand, the 
couple {£_r, LT^} is excisive because SrUII^ is equal to the union of the open 
sets LT^ and £# D Br. Recall Lemma |7| and that Br contains the compact 
set LT. Moreover, the intersection of ifi and T,r is not empty because T,r is 
unbounded. Hence, the following exact Mayer- Vietoris sequence for reduced 
homology holds, see [T51 p. 189] or p. 229], 

o = h^r u n c ) -» H (z R n n c ) - h (e r ) e # (n c ) -» . 

Notice that a topological space Y is arcwise connected if and only if the 
reduced homology group H$(Y) vanishes. The fact that n is rationally 
convex and Lemma El automatically imply that ifi and are both arcwise 

n 

connected spaces, and so their intersection S^nn is also arcwise connected. 
We can conclude that Q~ l (VL) union ifi is simply connected, after recalling 
a paragraph above. □ 
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The next steep implies extending Lemma El to consider arbitrary open 
sets Q in C with a finite number of holes. 

Lemma 9. Let Q : C n — > C be a holomorphic polynomial, for n > 3, and 
II be any compact rationally polyhedron in C n whose complement is simply 
connected. The union of Q~ 1 (£l) and C n \ II is then simply connected for 
every open connected set f2 in C with a finite number of holes. 

The fact that f2 C C has a finite number of holes means that his funda- 
mental group vri (Q) is free and finitely generated. Moreover, the conclusions 
of Lemma OH are quite interesting when LT is a compact ball. 

Proof. The result is trivial whenever Q is a constant polynomial, so we 
suppose from now on that Q is a non-constant function. Define LT to be 
the complement C n \ LT, so the open set ifi is simply connected because of 
the given hypotheses, and arcwise connected because LT is rationally convex. 
Recall the finite set Aq defined in Theorem H3 We prove this lemma by 
considering different open sets in C of increasing complexity. 

Suppose that f2i is an open set in C \ Aq diffeomorphic to C. Given any 
compact closed path (loop) Ti inside Q~ l (Qi) union IT-', the compact sets 
Q(Ti nLT) and Aq are far away one from each other. Therefore, there exists 
a bounded open set Q2 C ^i such that the loop Ti is contained in Q~ 1 (fl2) 
union LT^ and the compact closure ^2 is both diffeomorphic to the unit disk 
{\w\ < 1} and contained in Qx. Notice that Aq does not meet f^. A direct 
application of Lemma |H] yields that Ti is homotopically trivial in Q~ 1 (&2) 
union LT^ and in the larger space union LT^. That is, the union of 

<5 _1 (f2i) and II ^ is simply connected. 

Suppose that is any open connected set in C\Aq with a finite number 
of holes. We may decompose O3 = V\ U V2 as the union of two open sets 
Vk diffeomorphic to C and whose intersection V\ D V2 has a finite number of 
connected components. Every open set Q~ l {Vk) Ulfi is arcwise connected 
because his complement LT \ Q~ l {Yk) is a rationally convex set. Previous 
paragraph implies that spaces Q _1 (Vfc) U ifi are both simply connected, for 
k = 1,2. Finally, notice that flfeQ -1 ^) 

union LT is arcwise connected 
because his complement is also a rationally convex set. We just need to 
apply Van-Kampen's theorem, in order to deduce that Q _1 (^3) union il'' is 
simply connected as well. That is, given two arcwise and simply connected 
open sets, their union is simply connected whenever their intersection is 
arcwise connected, see ^ p. 63] or (HI p. 161]. 

Finally, suppose that O4 is any open connected set in C n with a finite 
number of holes, so that Aq may intersect Let T4 be any closed path 
(loop) in the open set Q -1 ^^) union n c . There is a smooth loop T5 ho- 
motopic to T4 inside Q —1 (^4) union LT^ such that T5 meets transversally 
each Whitney's strata of every singular fibre Q~ 1 (s), for s in n Aq, recall 
Corollary 1.12 in 5, p. 6] and section 11-15 in [HI pp. 114-118]. The loop T5 
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has real dimension one and every fibre Q~ 1 (s) has real codimension two in 
C n , so the loop T5 meets no singular fibre Q~ 1 (s) for s in f^n Aq. Previous 
paragraph implies that T5 is homotopically trivial in Q — 1 (S^4 \ Aq) union 
II'', because \ Aq has a finite number of holes. Thus, the original path 
T4 is homotopically trivial in the larger space Q -1 ^^) union LT^, and so 
this union is simply connected, as we wanted to show. □ 

Notice that previous lemma may be extended to consider any open set 
£1 in C. Nevertheless, the proof becomes more complicated than what we 
really need in this paper. We are now in position to prove Theorem ^ 

Proof. (Theorem^). We begin by proving that the complement of a ra- 
tional polyhedron is simply connected. Let II C C n be a compact rational 
polyhedron defined according to equation (j3J), for n > 3. Notice that the 
complement of a compact ball C n \B is simply connected, because it has the 
homotopy type of the sphere 5 2n_1 . From LemmaEl we have that the com- 
plement of the rational polyhedron Q^ 1 (D\) n B is also simply connected, 
because it is equal to Q]~ 1 (C \ D\) union C™ \ B. Following an inductive 
process on the polynomials Q^, and using Lemma 03 in every step, we can 
conclude that the complement C n \ LT is simply connected as well. 

On the other hand, let K be any compact rationally convex set in C n , and 
T a closed path in the complement C n \K. We automatically have, from the 
definition, that there exists of a compact rational polyhedron LT C C n which 
contains K and does not intersect T. Thus, the path T is homotopically 
trivial in C™ \ IT, according to the previous paragraph; and so, T is also 
homotopically trivial in the larger set C \ K. The complement of K is then 
simply connected, as we wanted. □ 

3. Applications 

We want to finish this paper with the following application of Corollary 
Recall that the rational convex hull r(K) of a compact set K C C™ is equal 
to the intersection of all compact rational polyhedra LT C C n which contains 
K, see for example or [2]. The compact set K is obviously contained 
in its rationally convex hull r{K). Besides, given a continuous function / 
defined from the q-dimensional sphere S q into an open subset Q, C C", we 
say that / is homotopically trivial in Q if and only if it has a continuous 
extension to the compact (q + l)-dimensional ball. 

Corollary 10. Let K C C n be a compact rationally convex set, for n > 3, 
and f be a continuous function defined from the sphere S q into C n \K , which 
is not homotopically trivial there. The image f{S q ) intersects the rationally 
convex hull r(K) whenever 1 < q < n — 2. 

Proof. If the image f(S q ) does not intersects r(K), then, / is homotopically 
trivial in the complement of r(K) because Corollary 0] Hence, the function 
/ is also homotopically trivial in the larger set C n \ K, contradiction. □ 
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We can deduce a similar result for homology. Recall that a g-cycle C q 
in an open subset C C n is formally a finite sum gtfk of continuous 
functions fk defined from the standard g-dimensional simplex A q into Jl, 
and coefficients gt in a commutative group G, see ^Sj or We define the 
image of C q as the union of all fk(A q ) for the coefficients gt ^ 0. 

Corollary 11. Lei i<C C C n &e a compact rationally convex set, for n > 3, 
and C g 6e a q- dimensional cycle in the complement C" \ K , which is not 
homologous to zero there. The image of C q intersects the rationally convex 
hull r{K) whenever 1 < q < n — 2. 

There exists a basic difference between homotopy and homology. Given 
a continuous function / defined from S q into an open set f2 C C™. We can 
express S g as the union of two compact hemispheres D and E, and so we 
have that C q := f\r) + / |# is a g-cycle. The cycle C q is homologous to zero 
in f2, whenever / is homotopically trivial there. Nevertheless, the cycle C q 
may be homologous to zero, even when / is not homotopically trivial. 

Moreover, the difference between the first homotopy group and the 

fundamental group 7ir (•) is essential, even when H\(-) is the abelianisation of 
7Ti(-). For example, recalling that an arc T is homeomorphic to the compact 
unit interval [0, 1] in the real line, we automatically have that the Alexander 
cohomology groups H k (T) vanish for every k > 1, and so the first homology 
group i^i(C n \T) vanishes for n > 1 as well because Alexander's duality the- 
orem p. 352]. Nevertheless, Rushing (21 §2.6] produces several examples 
of arcs T in C n whose complement is not simply connected. In particu- 
lar, Rushing work produces examples of arcs (and copies of the Cantor set) 
which cannot be rationally convex sets, according to Theorem ^ 
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